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Last two decades have been characterized by an increasing interest in the 
analysis of the maximal growth rate of long products generated by matrices 
belonging to a specific set/family. The maximal growth rate can be evaluated 
considering a generalization of the spectral radius of a single matrix to the 
case of a set of matrices. 

This generalization can be formulated in many different ways, never¬ 
theless in the commonly studied cases of bounded or finite families all the 
possible generalizations coincide in a unique value that is usually called joint 
spectral radius or simply spectral radius. The joint spectral radius, however, 
can prove to be hard to compute and can lead even to undecidable prob¬ 
lems. We present in this paper all the possible generalizations of the spectral 
radius, their properties and the associated theoretical challenges. 

From an historical point of view the first two generalizations of spectral 
radius, the so-called joint and common spectral radius, were introduced 
by Rota and Strang in the three pages paper “A note on the joint spectral 
radius ” published in 1960 [62]. After that more than thirty years had to 
pass before a second paper was issued on this topic: in 1992 Daubechies 
and Lagarias [21] published “Sets of matrices all infinite products of which 
converge ” introducing the generalized spectral radius, conjecturing it was 
equal to the joint spectral radius (this was proven immediately after by 
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Berger and Wang and presenting examples of applications. From then 
on there has been a rapidly increasing interest on this subject and the more 
years pass the more the number of mathematical branches and applications 
directly involved in the study of these quantities increases [3]. 

The study of infinite products convergence properties proves to be of 
primary interest in a variety of contexts: 

Nonhomogeneous Markov chains, deterministic construction of functions 
and curves with self-similarities under changes in scale like the von Koch 
snowflake and the de Rham curves, two-scale refinement equations that arise 
in the construction of wavelets of compact support and in the dyadic inter¬ 
polation schemes of Deslauriers and Dubuc ED EE], the asymptotic behav¬ 
ior of the solutions of linear difference equations with variable coefficients 
[28„ 29 1 150] , coordination of autonomous agents mmaisj, hybrid systems 
with applications that range from intelligent traffic systems to industrial pro¬ 
cess control nn, the stability analysis of dynamical systems of autonomous 
differential equations [15], computer-aided geometric design in constructing 
parametrized curves and surfaces by subdivision or refinement algorithms 
mm, the stability of asynchronous processes in control theory m, the 
stability of desynchronised systems [T5j, the analysis of magnetic recording 
systems and in particular the study of the capacity of codes submitted to 
forbidden differences constraints PIE!, probabilistic automata m, the dis¬ 
tribution of random power series and the asymptotic behavior of the Euler 
partition function m, the logarithm of the joint spectral radius appears 
also in the context of discrete linear inclusions as the Lyapunov indicator 
mm- For a more extensive and detailed list of applications we refer the 
reader to the Gilbert Strang’s paper “ The Joint Spectral Radius ” |65] and to 
the doctoral theses by Jungers and Theys [S21 166]. 

The paper develops as following: in Section [l] we give notation and ter¬ 
minology used throughout this paper; Section [2] presents first a case of study 
associated with the asymptotic behavior analysis of the solutions of linear 
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difference equations with variable coefficients, further, it contains the defini¬ 
tions and properties of all the possible generalizations of spectral radius for a 
set of matrices, in particular the irreducibility, nondefectivity and finiteness 
properties are discussed. 

1 Terminology, notation and basic properties 

In this Section we provide notation, terminology, definitions and prop¬ 
erties which are employed in this paper. 

We use the expression No meaning the set of natural numbers, included 
zero. All the matrices and vectors that we consider have real or complex 
entries. We denote the conjugate transpose of an m-by-n matrix X = [xij] by 
X* = [xji] , while the simple transpose as X T = [. xp]. 

For p G [l,o°), the l p norm of a vector w G C" is given by ||w|| ; , = 

VTUHiW 

In particular: 

/* — The sum norm ||w||i =L,-|vr[/]| 

1 2 — The Euclidean norm ||w||2 = \/Y!i= l |w[/]| 2 = \Jw*w 
r — The max norm ||w||oo = max J= i |w[j]|. 

If A is a square matrix, its characteristic polynomial is Pa( 0 := det (f/—A), 
where det stands for determinant m Section 0.3]; the (complex) zeroes of 
Pa{i) are the eigenvalues of A. A complex number A is an eigenvalue of A if 
and only if there are nonzero vectors x and y such that Ax = 'kx and y*A = Ay*; 
x is said to be an eigenvector (more specifically, a right eigenvector ) of A 
associated with A and y is said to be a left eigenvector of A associated with 
A. The set of all the eigenvalues of A is called the spectrum of A and is 
denoted by o(A). The determinant of A, detA, is equivalent to the product 
of all its eigenvalues. If the spectrum of A does not contain 0 the matrix 
is said nonsingular (A nonsingular if and only if detA ^ 0). The spectral 
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radius of A is the nonnegative real number p(A) = max{|A| : A € cj(A)}. If 
A e <r(A), its algebraic multiplicity is its multiplicity as a zero of 
its geometric multiplicity is the maximum number of linearly independent 
eigenvectors associated with it. The geometric multiplicity of an eigenvalue 
is never greater than its algebraic multiplicity. An eigenvalue whose algebraic 
multiplicity is one is said to be simple. An eigenvalue A of A is said to 
be semisimple if and only if rank(A — A I) =rank(A — A I) 2 i.e. A has the 
same geometric and algebraic multiplicity. If the geometric multiplicity and 
the algebraic multiplicity are equal for every eigenvalue, A is said to be 
nondefective, otherwise is defective. 

We let e\ indicate the first column of the identity matrix I: e\ = 
[1 0 ••• 0] 7 . We let e = [1 1 ••• l] r denote the all-ones vector. When¬ 
ever it is useful to indicate that an identity or zero matrix has a specific 
size, e.g., r-by-r, we write I r or 0,-. 

Two vectors x and y of the same size are orthogonal if x*y = 0. The 
orthogonal complement of a given set of vectors is the set (actually, a vector 
space) of all vectors that are orthogonal to every vector in the given set. 

An n-by-r matrix X has orthonormal columns if X*X = I, . A square 
matrix U is unitary if it has orthonormal columns, that is, if U* is the 
inverse of U. 

A square matrix A is a projection if A 2 = A. 

A square matrix A is row-stochastic if it has real nonnegative entries 
and Ae = e, which means that the sum of the entries in each row is 1; A is 
column-stochastic if A T is row-stochastic. We say that A is stochastic if it 
is either row-stochastic or column-stochastic. 

The direct sum of k given square matrices X x ,..., X k is the block diagonal 
matrix 


X] ■■■ 0 

0 • • • X k 


= X x ®---®X k . 
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The k-by-k Jordan block with eigenvalue A is 


A 1 0 


•4(A) = 


l 

A 


•4(A) = [A], 


Each square complex matrix A is similar to a direct sum of Jordan blocks, 
which is unique up to permutation of the blocks; this direct sum is the 
Jordan canonical form of A. The algebraic multiplicity of A as an eigenvalue 
of .4(A) is k ; its geometric multiplicity is 1. If A is a semisimple eigenvalue 
of A with multiplicity m, then the Jordan canonical form of A is A/,„©/, in 
which / is a direct sum of Jordan blocks with eigenvalues different from A; 
if A is a simple eigenvalue, then m = 1 and the Jordan canonical form of A 
is [A]©/. A is diagonalizable, i.e. its Jordan canonical form is given by a 
diagonal matrix, if and only if is nondefective. 

In a block matrix, the symbol ★ denotes a block whose entries are not 
required to take particular values. 

We consider A 0 = I. A matrix B is said to be normal if BB* = B*B, unitary 
if BB* = B*B = /, Hermitian if B = B*. Hermitian and unitary matrices are, 
by definition, normal matrices. 

A proper subset of a set srf is a set SS that is strictly contained in srf. 
This is written as SS £ srf. 

Besides the Jordan canonical form, we need to introduce an additional 
matrix factorization, the so-called singular value decomposition (in short 
svd): Given a square matrix A E C" x " with rank k <n, there always exists a 
diagonal matrix A 6 M” xn with nonnegative diagonal entries 0 \ > 02 > • • • > 
Ok > 0]h- 1 = ■ ■ ■ = o„ = 0 and two unitary matrices U,V € C nxn such that 
A = U AT*, which is defined as the singular value decomposition of A. The 
matrix A = diag((7i,..., o n ) is always uniquely determined and of > • • • > of 
correspond to the eigenvalues of the Hermitian matrix AA*. Values 0\ ,..., o„ 
are the so-called singular values of A. 
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The trace of an nxn —matrix A, denoted by tr (A), is given by the sum of 

the diagonal elements of A, tr(A) = a a■ an d ^ is also equal to the sum 

of all the eigenvalues in the spectrum of A, tr (A) = £ A. 

Aecy(A) 

The spectral radius of a square matrix A E C' !X ” is defined as 


p(A) = max{|A| : A E c(A)} 


( 1 ) 


It is easy to prove that p(A k ) = ( p(A)) k for every k E N and, thus, given a 
generic power £ of the matrix A, the value (p(A i )) 1// * is just equal to the 
spectral radius of the matrix. 

It is possible to characterize the spectral radius using the trace of the 
matrix. Since A* E <7 (A k ) for every eigenvalue A E <7(A) and for every IeN, 
it follows that 


tr (A*)| lA = P(A) 


A6CT(A) 


1 /* 


( 2 ) 


which converges to p(A) as k —> °o 


p(A) = lim |tr(A*)| 1 . /i 


( 3 ) 


For a square matrix A and for p E [1,°°], ||A|| p is the matrix norm induced 
by the corresponding p —vector norm. The induced matrix norms are some¬ 
times defined as operator norms EDI Definition 5.6.3]. Among the induced 
matrix norms we will make use of the following 


The maximum column—sum norm ||A||i = max ||Ax||i = max V \cii j\ 

IWIi=i J i 

The spectral norm ||A ||2 = max ||Ajc ||2 = <7i(A) = y/p(AA*) 

lhlb=i 

The maximum row—sum norm ||A||oo = max ||Ajc||o<. = max 

Every induced matrix norm || • ||* is submultiplicative i.e. ||AB||* < ||A||*||fi||* 
for every square matrix A and B. 
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Another family of induced matrix norms are the ellipsoidal norms. Let us 
consider an Hermitian positive definite matrix P y 0 (i.e. P is a nonsingular 
Hermitian matrix such that x*Px > 0 for all nonzero x E C” or, equivalently, 
P is a Hermitian matrix such that all its eigenvalues are strictly positive). 
The vector ellipsoidal norm is defined as 

j|x||p = Vx*Px. (4) 

The corresponding induced matrix norm is given by 

||A||p= max ||Ax||p= max Vx*A*PAx (5) 

||*lh=i Vx*Px= l 

Recalling that m Corollary 7.2.9] P is positive definite if and only if 
there exists a nonsingular upper triangular matrix T E C nxn , with strictly 
positive diagonal entries, such that P = T*T, which is defined as the Cholesky 
decomposition of P, we can rewrite ||A||p = max ^ x * T * Tx ~x \/x*A*T*TAx = 
max|| 7 ’_ c || 2= i ||rAx|| 2 and if we rename y = Tx, T by construction is nonsin¬ 
gular so x = T~ l y, we get 

j|A||p = max ||rAr _1 y|| 2 = \\TAT ~ l \\2 = Jp(TAT(TAT~ x )*) (6) 

l|v|| 2 =l v 

Since T is nonsingular and remembering that the spectrum of a matrix is 
invariant under similarity transformation, two matrices M and T~ l MT have 
the same eigenvalues, counting multiplicity. So from © we obtain that 

]|A||p = \J p(TAP~ l A*T*) = sJp(AP- l A*P) (7) 

Given a generic power k of the matrix A, the value 11A*11 X// * is defined 
as the normalized norm of the matrix, in the sense that is normalized with 
respect to the length of the product. 

Given the family & = {A,},- 6t / of complex square n xn -matrices, with 
JT a set of indices, & is defined bounded if it does exist a constant C < +°° 

such that sup ||A, || < C. While we define the set finite if it is constituted by 

iej? 

a finite number of matrices. Trivially a finite set is always bounded. 
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A matrix A is said to be nondefective if and only if its Jordan canonical 
form is diagonal i.e. each eigenvalue of A is semisimple or, equivalently, it has 
geometric multiplicity equal to algebraic multiplicity, otherwise A is defined 
defective. In this paper we deal with a weaker condition of nondefectivity: a 
matrix A is said to be weakly nondefective if and only if the eigenvalues of A 
with modulus equal to the spectral radius, i.e. with maximal modulus, are 
semisimple, if it is not the case the matrix is defined weakly defective. Using 
the Jordan canonical form of A it is easy to prove that, whenever p(A) > 0, 
defined A* = A/p (A), A is weakly nondefective if and only if powers (A*) k are 
bounded for every k > 1. 

From now on, for the sake of simplicity and to be coherent with the 
literature on the spectral radius of sets, we use the expressions strongly 
nondefective and strongly defective in place of nondefective and defective, 
whereas we make use of the words nondefective and defective meaning weakly 
nondefective and weakly defective. 

Let us now recall basic relations between spectral radius and matrix 
norms: 

1.1 Theorem 1 pEOl Theorem 5.6.9]). If || ■ || is any matrix norm on C nxn 
and if A e C nxn , then p(A) < ||A||. 

Furthermore 

1.2 Lemma ([40, Lemma 5.6.10]). Let A e C nxn , for every e > 0 there is a 
matrix norm || ■ || g such that 

p(A) < ||A|| e <p(A) + e (8) 

The spectral radius of A is not itself a matrix or vector norm, but if we 
let e —> 0 in ([8]) we have that p (A) is the greatest lower bound for the values 
of all matrix norms of A 

p(A)= inf ||A|| (9) 

ll-lleA" 
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where JV denotes the set of all possible induced matrix norms (the so-called 
operator norms). 

Spectral radius allows to characterize convergent matrices , i.e. those 
matrices whose successive powers tends to zero: 

1.3 Theorem (j30 ; Theorem 5.6.12]). Let A G C" x ”, then limA^ = 0 

°° 

p(A) < 1 

As a Corollary of the previous Theorem we have the so-called Gelfand’s 
formula: 

1.4 Corollary ( fUJ . Corollary 5.6.14]). Let || • || be any matrix norm on 
C nxn , then 

p(A) = lim \\A k \\ l l k for all A G C nxn (10) 

The Gelfand’s formula gives us two information: 

• the spectral radius of A represent the asymptotic growth rate of the 
normalized norm of A k : j|A*|| l / k ~ p(A) as k —> °° 

• the normalized norm ||A*|| 1 /* can be used to approximate the spectral 
radius and in the limit for k —> °° the two quantities coincide. 

Given a row-stochastic matrix A its maximum row-sum matrix norm 
is equal 1 by definition of row-stochasticity. By Theorem choosing 
as matrix norm the maximum row-sum, we have that for every stochastic 
matrix A 

p(A) < ||A||oo = 1 (11) 

The row-stochasticity of A can be formulated also as 

Ae = e (12) 

with e the all-ones vector and A = 1 the eigenvalue of A associated with the 
right eigenvector x = e. So we have that p(A) = 1. Remembering that the 
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set of stochastic matrices is closed under matrix multiplication, we observe 
that the very same result can be proved also using the Gelfand formula: 
choosing as matrix norm the maximum row-sum we have that ||A fe ||I/* = 1 
for every integer k > 1. 

In the following we generalize all these notions to the case of a family of 
matrices. 

For a systematic discussion of a broad range of matrix analysis issues, 
see [SO] , 


2 Framework 


2.1 A case of study 

Given a stable discrete time system we want to analyze its robustness 
with respect to perturbations not a priori quantifiable. 

Let us consider the system 


x(k+ 1) = Aox(k), k £ Nq. 


(13) 


with x(0) € C" and A o £ C" x " such that the system is asymptotically stable, 


i.e. p(A o) < 1 (ref Theorem 1.3). We consider the perturbed system given 


by time-varying perturbations 


c(k +1) — ( Aq + ^ 8j(k)Aj j x(k\ k £ Nq. 


(14) 


i =1 


The matrices { Ai}f ={ are known, but the perturbations {5;(A:)}f =1 are not. 
The perturbations may depend on incomplete modeling, neglect of dynamics 
or measurement uncertainty. We are interested to know if a stability result 
for the theoretical model 


holds also for the real system (14) 


The perturbed system (14) can be regarded as a first order system of 


difference equations with variable coefficients 


x(k+ 1) = Y ik x(k), ke Nq. 


(15) 
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where jc( 0) £ C" and Y lk £ C' ,x " is an element of the following family 


a — + 52 
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( 16 ) 


where 8 = (5i 82 ■ ■ ■ 8 P ) and the bound on the uncertainties is known. This 
kind of problems arise in several contexts such as when applying numerical 
methods to non-autonomous systems of differential equations. 

From a point of view of robustness or worst case analysis the goal is to 
determine the largest uncertainty level a* such that for every a < a* the 
system remains stable (see e.g. m)- 

If the sequence of matrices Y lk is known, for k > 0, then the solution of 


(15) is given by 

x(k + 1) = Pkx( 0), 


with P/. = Yij , k > 1 
1=1 


(17) 


where asymptotic stability may be studied directly (although this is not an 
easy task in general). Nevertheless we want to study the case where the 
sequence {Yi k }k>i is not known a priori and may be whatever. 


2.1 Definition (Uniform asymptotic stability 
uniformly asymptotically stable if 


u.a.s.). We say that (15) is 


limv(/c)=0 (18) 

>00 

for any initial v(0) and any sequence {Fi *}1 of elements in YP a - 


It is easy to prove that Definition 2.1 is equivalent of requiring that any 


■ Yj } of matrices from vanishes as k —> 


possible left product Y- lk ■ Yj k _ x -... ■ ± ik ui mauara num a 

We observe that in the context of the discrete linear inclusions some 
authors refer to the uniform asymptotic stability as absolute asymptotic sta¬ 


bility [85.. [66] • 

For the single matrix case we have that u.a.s. holds if and only if the 
spectral radius of the matrix is strictly less than one, while for the general 
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case of a family of matrices & we are driven to the problem of computing the 
joint spectral radius of &. The intrinsic difficulty in exploiting this quantity 
is due to the non-commutativity of matrix multiplication. 

2.2 Definitions and properties 
2.2.1 Definitions 

From now on we consider always complex square nxn-matrices and sub- 
multiplicative norms if not differently specified. Let & = {A;} i6jzr be a family 
of matrices, J? being a set of indices. 

For each k= 1,2,..., consider the set of all possible products of length 

k whose factors are elements of JP, that is &k{^) = {A (1 ■... - A^ | q,... ,4 € 
and set 

= 1J &k(&) (19) 

k> l 

to be the multiplicative semigroup associated with &. While, defined 
^o(^) := /, we have 

&’*(&) = \J &’*('?) ( 20 ) 

lc> o 

the multiplicative monoid associated with &. 

We present four different generalizations of the concept of spectral radius 
of a single matrix to the case of a family of matrices &. 

The first generalization is due to Rota and Strang, in the seminal paper 
|62| published in 1960 they presented the generalization of the notion of 
spectral radius as limit of the normalized norm of a single matrix: 

2.2 Definition (Joint Spectral Radius - jsr). If || ■ || is any matrix norm 
on C" xn , consider pk(<^) := sup Pe g!> k (gF)\\P\\ 1 / k , k£ N i.e. the supremum 
among the normalized norms of all products in an d define the joint 

spectral radius of as 

jsr{&) = p(^) = lim p k {&) (21) 
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The joint spectral radius does not depend on the matrix norm chosen 
thanks to the equivalence between matrix norms in finite dimensional spaces. 

We observe that in the discrete linear inclusions literature the logarithm 
of the joint spectral radius is sometimes called Lyapunov indicator [I]. 

In 1992 Daubechies and Lagarias [21] introduced the generalized spectral 
radius as a generalization of the limsup over all the spectral radii p(A k ) l / k , 
k> 1, which are, trivially, always equal to p(A). 

2.3 Definition (Generalized Spectral Radius - gsr). Let p(-) de¬ 

note the spectral radius of an n x n-matrix, consider p A ( &) := 
su P/>e^(^)P( P ) lA ’ k£N i.e. the supremum among the spectral radii 
of all products in normalized taking their k~th root, and define the 

generalized spectral radius of LF as 

gsr(^) = p(^") = limsup ~p k (&) (22) 

k—> 

For this two definitions it has been proved by Daubechies and Lagarias 
HU 122] the following 

2.4 Proposition (Four members inequality). For any set of matrices LF 
and any k> 1 

P k (&) < P(^) = gsr(^) < jsr(&) = p(&) < pk{&) (23) 

independently of the submultiplicative norm used to define p k (&). 

As a consequence of this we have that: 

P(^) = in( Pki-P) (24) 

k>l 

p(&) = supp A (^) (25) 

k> 1 

For the first equality see also [ 421 Lemma 1.2]; for the second one, since 
p(M k ) = p(M) k for every k G N and considering that by definition of limsup 

limsup p k {&) = inf sup p n (&), 

> co —1 n>k 
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if it does exist a finite product P G r G N, such that p(P)'/ r = p(^), 

then, for every m G N, p(P"‘) ] / mr = p(j£") and, thus, sup n>i p n (J^") = p(J£") 
for every k G N. This last equality is valid also if it does not exists such a 
finite product, in fact in this case the sup is achieved only for n —> °°. So in 


both cases it results inf^i sup n>jt p n (&) = sup jt>1 p k (.^), i.e. equation (25) 
holds true. 

A third definition has been introduced by Chen and Zhou in 2000 m 
and is based on a generalization of the formula associating the spectral radius 
of a matrix with its trace: 


2.5 Definition (Mutual Spectral Radius - msr). Let tr(P) be the trace of 
the product P G .^(J^ - ) then sup |tr(P)| is the maximal absolute value 

among all the traces of the products of length k. Define the mutual spectral 
radius of & as 

msr(^) = limsup sup |tr(P)| 1//<L (26) 

k —>°° 

We present now the last characterization of the spectral radius of a family 
of matrices. For bounded sets (ref Section [I]) it is possible to generalize the 
concept, express in equation of spectral radius as the inf over the set of 
all possible induced matrix norms of A. 

2.6 Definition (Common Spectral Radius - csr). Given a norm || • || on the 
vector space C" and the corresponding induced matrix norm, we define 


]|^|| := sup 11A,-11 (27) 

iej? 

where we assume that the family LP is bounded. We define the common 
spectral radius of AP (see J603] and f2S\ \j ) as 

csr(^) = p(LF) = inf [|^"|| (28) 

ll-lleV 

where JL denotes the set of all possible induced matrix norms. 


14 



This definition was first introduced by Rota and Strang in 1960 [62] and 
re-introduced 35 years later by Eisner [23]. 

In the case of bounded sets, it is possible to prove that the four charac¬ 
terizations we presented coincide. 

2.7 Theorem (The Complete Spectral Radius Theorem). For a bounded 
family 3F the following equalities hold true 

gsr(^) = jsr(^) = csr(^) = msr(^) (29) 


The equality of gsr and jsr was conjectured by Daubechies and Lagarias 
and it was proven by Berger and Wang [2], Eisner [23], Chen and Zhou na, 
Shih et al. [64] . For the equality of csr and jsr we refer the reader to the 
seminal work of Rota and Strang f62] or again [23] . Chen and Zhou m 
proved the last equality. 

We observe that the first equality is the generalization of the Gelfand’s 
formula (Corollary |1.4[ ) to the case of a family of matrices. 

Another observation is that even though the joint and generalized spec¬ 
tral radius can be defined also for unbounded families the first equality does 
not hold in general. Consider for example the unbounded family: 



For this family since every product of the two matrices is upper triangular 
with ones in the main diagonal it is evident that p’(j^) = 1 and obviously 
p(j^) = +°° since the family is unbounded (see [66] for details and [21] for 
another example). 

We observe also that Gurvits in [35] give a counterexample to the first 
equality in the case of two operators in an infinite dimensional Hilbert space. 

From now on and if not differently specified we will always consider 


bounded sets of matrices. Theorem 2.7 implies that we can simply refer to 
the spectral radius p(of the family of matrices jF. 
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2.8 Definition (Trajectory). Given a family TP = {Ai} iejr , we define, for 
an arbitrary nonzero vector x G C n , the trajectory 

& \&,x] = {Px | P G &{&)} (30) 

as the set of vectors obtained by applying all the products P in the multi¬ 
plicative semigroup TP(JP) to the vector x. 

2.9 Definition (Discrete linear inclusion). The discrete linear inclusion is 
the set of all the trajectories associated with all the possible vectors in C". 
This set is denoted by DLfi^P). 

2.2.2 Properties 

We resume now properties valid for the spectral radius of a bounded set 
of matrices JP = {A,} i6 ^ 

1. Multiplication by a scalar: For any set & and for any number a G C 

p(a&) = \a\p(&) (31) 

2. Continuity: The joint spectral radius is continuous in its entries as 

established by Heil and Strang [38]. Wirth has proved m that the 
joint spectral radius is even locally Lipschitz continuous on the space 
of compact irreducible sets of matrices (an explicit formula for the 
related Lipschitz constant has been evaluated by Kozyakin p[?]h 

3. Powers of the family: For any set and for any k> 1 

p(P k )<p k (P) 

4. Invariance under similarity: The spectral radius of the family is in¬ 

variant under similarity transformation, so for any set of matrices TP, 
and any invertible matrix T 

p(J?) = p(T^T- 1 ) (32) 
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This because to any product A\ ■... ■A k £ ^(J^ - ) corresponds a prod¬ 
uct T ■Ai •... -Ak ■ T 1 G with equal spectral radius. 

5. Conjugate or transposed family: The conjugate or transposed fam¬ 
ily (family obtained taking the conjugate/transpose of every matrix in 
the original set) has the same spectral radius as the original one [571 
Lemma 5.1] 

p(JP*)=p(J0 P(^ r ) = p(^) (33) 


6. Block triangular matrices: Given a family of block upper triangular 
matrices 


& = 


Ai Bj 
0 Ci 


we have that 




P{&) = max{p({A / } i . e ^),p({C,} ie ^)}. (34) 

This is due to the closure, with respect to the multiplication, of block 
upper triangularity (2]., Lemma II (c)]. Clearly the same holds for lower 
triangular matrices. This result generalizes to the case of more than 
two blocks on the diagonal. 

7. Closure and convex hull: The closure and the convex hull of a set 
have the same spectral radius of the original set 


p( conv^") = p(cli^) = p(j£") 


(35) 


This result was first obtained by Barabanov in 1988 [1]|. An alternative 
proof, given by Theys in (66] page 17], is based on the common spectral 


radius definition (28) and the property 


sup ||A,j| = sup 11Ai 11 = sup 11A, | 


A,-e^ 


A/Sconv,^ 


A/S cl 


(36) 
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8. Uniform asymptotic stability characterization [2| Theorem I (b)] 

For any bounded set of matrices LP and for any k > 1, all matrix 
products P E converge to the zero matrix as i.e. LP is 


uniformly asymptotically stable (ref page 11), if and only if p(j^") < 1. 

In other words the spectral radius of the family of matrices & gives 
information about the uniform asymptotic stability of the associated 


dynamical system DLI(J£"), defined on page 16 


9. Product boundedness [2J Theorem I (a)]: Given a bounded set of 
matrices J£", if products P E l£N, converge as k —> °o. Then, 


the multiplicative monoid defined in (20) is bounded and 

p(^) < 1. 

The opposite implication is not true in general: 

Given a defective family with p(J^) = 1, products P E IeN, 

explode for k —> °° by Definition |2.11| 

We return on this aspect in 

10. Special cases: 


1. Recalling that the set of stochastic matrices is closed under ma¬ 
trix multiplication and that every stochastic matrix has spectral 
radius equal 1 (ref Section [I]), if the matrices in & are all stochas¬ 
tic then the spectral radius of the family is exactly 1. 

2. If the matrices in AP are all upper-triangular, if they can be si¬ 
multaneously upper-triangularized, if all the matrices in & com¬ 
mutes or, more in general, if the Lie algebra associated with the 
set of matrices is solvable (commutative families are Abelian Lie 
algebras which are always solvable), if they are all symmetric or, 
more in general, if they are all normal or, finally, if they can be 
simultaneously normalized, then 

p(J^) = max {p(A,-)} (37) 

A;€^ 
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For more details see I33E3E2E3E2- 
3. If & = {A,A*} then p(J^) = p(AA*) 1 / 2 = <Ji(A) i.e. the largest 
singular value of A. In fact [661 Proposition 6.20] using the four 


members inequality (23) for 1 = 2 we have 


p(AA*) 1 / 2 = (7, (A) = ||AA* || 2 /2 (38) 

4. ([56] and [26, Theorem 4]). Consider the family & = {A,B} with 

I a b \ fa —b \ 

A := I ] , B := [ ] a,b,c, d E M 

c d 


a —b 
—c d 


The joint spectral radius of the family & is given by 

„(« J PW=P(B> «' ^>0 

\ \Jp ( AB ) if bc< 0 

5- ([56] and [26, Theorem 5]). Consider the family AP = {A,B} with 


A : = 


a b 
c d 


B:= 


d c 
b a 


a,b,c,d E ’ 


The joint spectral radius of the family & is given by 

= [ P( A ) =P( B ) if \a-d\>\b-c\ 

\ \Jp{AB) if \a — d\<\b — c\ 

6. Let |J^| be the family of matrices obtained from & as follows: 


A — [&ij\ £ & 


i^l — [\ a ij |] e \^\ 


Then 


P(|^|)>P(^) 


(39) 


From the previous result and the four members inequality (23) 
we have that 


P,(^)<P(^)<P( \&\) 
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So if P E k E N, is such that p(P) l / k = p (|^|), then 


p(^)=p(py/ k . 

11. Non—algebraicity: Any set composed of k real nxn matrices can be 

seen as a point in the space M far . Therefore, a subset of M far is a set 
of ^-tuples of n xh- matrices. Given a subset of M. k,r this is defined 
semi-algebraic if it is a finite union of sets that can be expressed by a 
finite list of polynomial equalities and inequalities. Kozyakin [45] has 
shown that, for all k,n> 2, the set of points x E such that p(x) < 1 
is not semi-algebraic and, for all k,n> 2, the set of points x E M*” 2 cor¬ 
responding to a bounded semigroup is not semi-algebraic (the 

original paper by Kozyakin contains a flaw and the correction has been 
published by the same author only in Russian. For a corrected ver¬ 
sion in English we refer the reader to the Doctoral work of Theys [66], 
Section 4.2]). In practice in the general case, given a discrete linear 
inclusion DLI(^), there is no procedure involving a finite number of 
operations that allows to decide whether DLI(J^") is uniformly asymp¬ 
totically stable or not i.e. the uniform asymptotic stability of DLI(j^) 
is in general hard to determine. 

12. NP—hardness: In [68] Tsitsiklis and Blondel proved that, given a set 

of two matrices 3P and unless P = NP, the spectral radius p(j^) is not 
polynomial-time approximate. This holds true even if all nonzero 
entries of the two matrices are constrained to be equal. Let us recall 
that the function p(j^") is polynomial-time approximable if there exists 
an algorithm p*(^,e), which, for every rational number £ > 0 and 
every set of matrices & with p(J^) > 0, returns an approximation of 
p(j^) with a relative error of at most £ (i.e. such that |p* — p| < £p) 
in time polynomial in the bit size of & and £ (if £ = p/q, with p and 
q relatively prime numbers, its bit size is equal to log(pg)); however 
there are algorithms which are polynomial either in the bit size of & 
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or in e. We conclude that the computation of the spectral radius of a 
set of matrices is in general NP-hard and, consequently, it is NP-hard 
to decide the stability of all products of a set of matrices (for a survey 
of NP-hardness and undecidability we refer the reader to |(T2|). We 
observe here that Gurvits in [3B] provides a polynomial-time algorithm 
for the case of binary matrices. 

13. Undecidability: A decision problem is a problem which output is bi¬ 
nary and can be interpreted as “yes” or “not”. For instance the problem 
of deciding whether an integer matrix is nonsingular is a decision prob¬ 
lem. Since the nonsingularity can be checked, for example, by com¬ 
puting the determinant of the matrix and comparing it to zero it is a 
decidable problem, i.e. a problem for which there exists an algorithm 
that always halts with the right answer. But there are also problems 
for which this kind of algorithm does not exist, these are undecidable 
problems. 

Given a set of matrices 

• The problem of determining if the semigroup is bounded 

is undecidable 

• The problem of determining if p(^) < 1 is undecidable 

These two results, which remain true even if & contains only rational 
entries nan, teach us that does not exist any algorithm allowing to 
compute the spectral radius of a generic set & in finite time. 

It is still unknown if it does exist in the generic case an algorithm that, 
given a finite set of matrices ^, decides whether p (?P) < 1. Such an 
algorithm would allow to check the uniform asymptotic stability of 
the dynamical system ruled by the generic set &. In the following we 
discuss the relation between this kind of algorithm and the so-called 
finiteness property. 
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The actual computation of p(J^) is an important problem in several 
applications, as we mentioned in the introduction of the present paper. Ac¬ 
cording to the previous properties of non-algebraicity, NP-hardness and 
undecidability the problem appears quite difficult in general. 

However, this is not reason enough for declaring the problem intractable 
and refraining from further research. As we discover in the next subsection 
the existence of an s.rn.p. for the family (i.e. a product in the semigroup 
with particular properties) allows in the general case to evaluate 
exactly the spectral radius of a family making use of the Definition 2.6 as an 


actual computational tool. In order to do this we need the inf in equation 


(28) to be a min, but this is always true for irreducible families. 


2.3 Irreducibility, nondefectivity and finiteness property 

is a min we say that the family & = admits 


When the inf in 
an extremal norm. 

2.10 Definition (Extremal norm). A norm 


satisfying the condition 


p{&) = Ill'll* := sup ||A,-||* 
iejr 


is said to be extremal for the family 3A (for an extended discussion see m- 

Equivalently a norm || ■ ||* is called extremal for a given set AP = {A;} !e jr 
if it satisfies ||A,||* < p(J^") for every i £/. 


From Proposition 2.4 it is clear that, for a given norm, this inequality 
cannot be strict simultaneously for all the matrices in the set. 

Given a bounded family & = {Aj} ie y of n x n-matrices with p(J£") > 0, 
the normalized family is given by 

Jf* = {A I -/p(Jf)} I . ejr (40) 

with spectral radius p(^*) = 1 and & (J^ - *) is the associated multiplicative 


semigroup (ref equation (19) on page 12). 
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The definition of (weakly) defective matrix, given in section [lj extends 
to bounded families of matrices as follows: 


2.11 Definition (Defective and Nondefective Families). A bounded family 
& of nxn-matrices is said to be defective if the corresponding normalized 
family AF* is such that the associated semigroup 0 s (&*) is an unbounded 
set of matrices. Otherwise, if either p(J^) = 0 or p(^) > 0 with & (dP*) 
bounded, then the family & is said to be nondefective. 


The following result can be found, for example, in [62] and [2]: 


2.12 Proposition. A bounded family & of nxn-matrices admits an ex¬ 
tremal norm || • ||* if and only if it is nondefective. 


As previously mentioned we want to make use of Definition 2.6 


as an 


actual computational tool for the spectral radius p(J^"). To do this we need 
to ensure that the family admits an extremal norm i.e. we have to check the 
detectivity or nondefectivity of the set &. 

Strictly connected to detectivity of a family there is the concept of re- 
ducibility. 


2.13 Definition (Reducible and Irreducible families). A bounded family 
,# = {Ai} ie jr of nxn-matrices is said to be reducible if there exist a non¬ 
singular nxn-matrix M and two integers n \, 112 > 1, n\ -\-ri 2 = n, such that 


M~ 1 AjM = 


A ; (11) A, (12) 


O 


,( 22 ) 


for all i € 


(41) 


where the blocks A^\ a[ 12 \ A- 22 ^ are n\Xn\~, n[Xni - and mx ^-matrices, 
respectively. On the contrary, if a family dF is not reducible, then it is said 
to be irreducible. 


Irreducibility means that only the trivial subspaces 0 and C" are invari¬ 
ant under all the matrices of the family &. Otherwise & is called reducible. 
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The concept of irreducibility was introduced in the joint spectral radius the¬ 
ory by Barabanov in [I], where he named irreducible families nonsingular 
sets. 

We observe that some authors refer to reducibility as decomposability 
(irreducibility as non-decomposability) in order to avoid confusion with the 
notion of reducibility commonly used in linear algebra |401 Definition 6.2.21]. 

An immediate consequence of irreducibility of SP is that p(&) > 0, in 
fact, in this case the semigroup is irreducible and, therefore, does 

not consist of nilpotent elements, by the Levitzky Theorem |49] . So we can 
always normalize an irreducible set of matrices & by obtaining a set 

with generalized spectral radius equal to 1. 

Another consequence of irreducibility of a family is stated in the next 
Theorem and its Corollary, which follow easily from the Barabanov’s con¬ 
struction of extremal norms for irreducible families of matrices [I]. 

2.14 Theorem ( |231 Lemma 4]). If a bounded family SP of nx n-matrices 
is defective, then is reducible. 


and, therefore, 


2.15 Corollary ([Tl 1251 f59| ). If a bounded family of matrices is irreducible 
then it is nondefective, i.e. it does exist an extremal norm for the family. 


In Figure [l] it is represented the space SB of bounded families of matrices 
in C nxn . This space can be split into the set of the reducible families SB and 
its complement J%, the set of the irreducible ones. Families of matrices can 
be nondefective or defective: the set of the defective families is a proper 
subset of ^ i.e. £ S%. In fact Theorem 2.14 implies that a defective 
family is always reducible, but the opposite implication is not necessarily 
true. For example, for n > 2 all single families & = {A} are clearly reducible 
as the Jordan canonical form proves, but not necessarily defective. The set 
of nondefective families the complement of in SB, is denoted by grey 
dots. 
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Figure 1: Space of bounded families of matrices SS\ the set of defective 
families is denoted by IF, while its complement, highlighted by dots, is the 
set of nondefective families 

About the dimension of set Si and Si Maesumi [52] proposed the following 
conjecture 

2.16 Conjecture. Reducible (decomposable) matrix sets form a set of mea¬ 
sure zero in the corresponding space of matrices. Defective matrix sets form 
a set of measure zero within the set of reducible matrices. 

In [IS] we delve further this analysis especially explaining how reducible 
families can be handled. 

We add just that Brayton and Tong in [15] give an alternative sufficient- 
condition for nondefectiveness. They prove that, considered each matrix 
P in the semigroup and the associated similarity matrix Sp that 

reduce P into its Jordan form, if every Sp has columns linearly indepen¬ 
dent uniformly on all P £ then & is nondefective. This alternative 

sufficient-condition represents the generalization of the concept of strongly 
nondefectiveness to the case of sets of matrices, in fact for a single matrix A 
strongly nondefectiveness is equivalent to semisimplicity of all the eigenval¬ 
ues in the spectrum of A or equivalently to diagonalizability of A (ref pages 
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[4]and[§. Clearly strongly nondefectiveness implies nondefectiveness, but 
checking this sufficient-condition is not feasible in practice. 

As previously mentioned there are not known algorithms for deciding 
uniform asymptotic stability of a generic set of matrices and it is unknown 
if this problem is algorithmically decidable in general. We have also seen 
that uniform asymptotic stability of the set & is equivalent to p(^) < 1. 
In order to check if p(j^") < 1 for finite families we may think of using the 


four members inequality (23) 


p k {^) < p(^) < Pk(^) for all k > 1 
The procedure could be the following GU: 


(1) We evaluate 

pA&):= max p(P) 1 ^ and p k {^) := max \\P\\^ k 

Pe& k {&) Pe^ k (^) 

for increasing values of k > 1. 

(2) As soon as p k < 1 or p k > 1 we stop and declare the set uniform asymp¬ 
totic stable or unstable respectively. 


We observe that this procedure always stops after finitely many steps 
unless p = 1 and p k <\ for all k > 1 , but this never occurs for families that, 
satisfying the finiteness property, have an s.m.p. 

2.17 Definition (Finiteness property and s.m.p.). A finite family & of 
n x n -matrices has the finiteness property if there exists, for some k>\, a 
product P G PP k {^) such that 

p(P)=p{&f. 

The product P is said to he a spectrum-maximizing product or s.m.p. 
for AF. Some authors refer to optimal product instead of s.m.p., see for 
instance \5f} f 
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An s.m.p. is said minimal if it is not a power of another s.m.p. of &. 
Any eigenvector x /O of P related to an eigenvalue A with |A| = p(P) is 
said to be a leading eigenvector of &. 


From the previous definition is evident that uniform asymptotic stability 
is algorithmically decidable for finite sets of matrices that have the finiteness 
property. 

Lagarias and Wang in 1995 [58] conjectured that the finiteness prop¬ 
erty was valid for all finite families of real matrices (the so-called finiteness 
conjecture) . Unfortunately this conjecture does not hold true: Bousch and 
Mairesse m and later other authors EH HE] presented non-constructive 
counterproofs. In particular in m Blondel et al. proved that for the para¬ 
metric family 


&a = {A, aB} 


1 

1 1 


’ 1 0 ’ 

1 



, a 



l 

0 1 


1 1 

1 


with a 6 [0,1] 


there exist uncountably many values of the parameter a, for which & a does 
not satisfy the finiteness conjecture. They were unable to find a single 
explicit value of a and they conjectured that the set of values a € [0,1] for 
which the finiteness conjecture is not satisfied is of measure zero. Recently 
Hare et al. m, using combinatorial ideas and ergodic theory, have been 
able to approximate, up to a desired precision, an explicit value a such 
that a does not satisfy the finiteness conjecture. The question if there 
exist families of matrices with rational entries that violate the conjecture 
remains still open. Based on all the numerical experiments developed in the 
last years and the results previously mentioned a new conjecture has been 
introduced: 


2.18 Conjecture ([TOl ES, Blondel et al. and Maesumi]). The finiteness 
property is true a.e. in the space of finite families of complex square matrices, 
i.e. the set of families of matrices for which the finiteness property is not 
true has measure zero in the space of finite families. 
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If this conjecture is true then it suggests us to track s.m.p.’s candidates 
out and validate them with some procedure in order to find the spectral 
radius of the family. In [18] we explain how to perform the validation step 
using particular extremal norms for the given set. 

The idea behind this last conjecture is that the NP-Tiardness, non- 
algebraicity and undecidability results are due to certain rare and extreme 
cases and that in the generic case the evaluation of the spectral radius, while 
could be computationally intensive, is possible. About the computational 
complexity we remind an example, given by Berger and Wang j2j Example 
2.1], of a set of two 2x2-matrices with minimal s.m.p. of length k > 1 with 
k arbitrarily large: 





0 

1 




with 


1 < a < 



-i 


They prove that p(^) = 1, p < 1 for j < k and p k+l (^) = 1. 

We recall that Blondel and Tsitsiklis in |13| proved also that the effective 
finiteness conjecture is false: 


2.19 Conjecture (Effective finiteness conjecture). For any finite set ^ of 
square matrices with rational entries there exists an effectively computable 
natural number t(^) such that p,(jr)(^) = p(J^) 

The falseness of this conjecture implies that, given a family of matri¬ 
ces with rational entries which admits a spectrum-maximizing product, the 
length of the s.m.p. can be arbitrary long and consequently the computation 
of the spectral radius can become a tough problem. Nevertheless for random 
families this product appears to be, luckily, quite short in general. 

The finiteness property is known to hold in many cases: 


• when the matrices in & are all simultaneously upper-triangularizable, 
or they can be simultaneously normalized, or the Lie algebra associated 
with the set & is solvable. In these cases, in fact, the spectral radius 
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is simply equal to the maximum of the spectral radii of the matrices 
(Property 10, special case [2] on page 18); 


• when a finite set of real matrices admits an extremal piecewise analytic 
norm in M”. A piecewise analytic norm is any norm on M" whose 
unit ball B has a boundary which is contained in the zero set of a 
holomorphic function f(z), he. complex differentiable at every point 
in its domain, defined on a connected open set Q £ C" containing 0, 
which has /(0) / 0 (Lagarias and Wang [15]): 


• when a finite set of real matrices admits an extremal piecewise algebraic 
norm in M”. A piecewise algebraic norm is one whose boundary is 
contained in the zero set of a polynomial p{z) £ M[z/, ... ,z n ], which has 
p( 0) 0. This is the case when the unit ball of a norm is a polytope 

[18], or an ellipsoid (ref page [ 7 ]), or the l p norm for rational p, with 
l < p <°o (Lagarias and Wang in [J8J extended the result proved by 
Gurvits in [35] for real polytope extremal norms to the general case of 
piecewise algebraic norms in M”); 


• when a finite set of matrices admits a complex polytope extremal norm. 
This it has been proved by Guglielmi, Wirth and Zennaro in |27, The¬ 
orem 5.1] extending to the complex case the results by Gurvits [35] 
and Lagarias and Wang [15]. We come back to polytope norms in [IS] . 

For other classes of sets of matrices the finiteness property has been 
only conjectured to be true, an example is the class of sets of matrices 
with rational entries. Indeed the proof of the finiteness property for sets 
of rational matrices would be satisfactory for practical applications: the 
matrices that one handles or enters in a computer are rational-valued. 

Recently Blondel and Jungers [13] have proved the following Theorem: 

2.20 Theorem ([13], Theorem 4]). 

1. The finiteness property holds for all sets of nonnegative rational ma¬ 
trices if and only if it holds for all pairs of binary matrices. 


29 



2. The finiteness property holds for all sets of rational matrices if and 
only if it holds for all pairs of matrices with entries in {—1,0,+1}. 


They proposed, consequently, the following conjecture 


2.21 Conjecture ( (>. £]. Blondel, Jungers and Protasov]). Pairs of binary 
matrices have the finiteness property. 


If this conjecture is correct then, by Theorem 2.20, nonnegative rational 
matrices also satisfy the finiteness property and, thus, the question p(J^) < 1 
becomes decidable for sets of matrices with nonnegative rational entries. 
From a decidability point of view this last result would be somewhat sur¬ 
prising since it is known that the closely related question p(j^) < 1 is known 
to be no algorithmically decidable for such sets of matrices (ref Property 13 
on page 21). Blondel and Jungers [43] proved that pairs of 2x2 binary- 


matrices satisfy the finiteness property and observed that the length of the 
s.m.p.’s is always very short. This result is promising even though a general¬ 
ization to the case of n x n -matrices seems quite difficult due to the falseness 


of the effective finiteness conjecture 2.19, which implies that the length of 
the s.m.p.’s for families of rcxrc-matrices can become extremely long. 

A more general version of the previous Conjecture is the following 

2.22 Conjecture ([51 Blondel, Jungers and Protasov]). The finiteness 
property holds for pairs of matrices with entries in {—1,0,+1} (the so-called 
sign-matrices). 


This last would imply, by Theorem 2.20 that the finiteness property 
holds for all sets of rational matrices. In [18] we prove analytically the 
finiteness property for pairs of 2x2 sign-matrices, i.e. matrices with entries 
in {-1,0,+1}. 
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